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ABSTRACT 

This  paper  presents  a  theory  of  verbal  understanding  based  on 
a  formal  model  of  conceptual  structures  that  represent  verbal  meanings 
expressed  in  English  sentences.  Verbal  understanding  is  defined  as  the 
capability  for  disambiguation,  paraphrase,  question  answering,  translation, 
etc.,  with  regard  to  natural  language  sentences.  The  model  has  been  imple¬ 
mented  as  Protosynthex  III  in  LISP  on  the  Q-32  time-shared  system.  Experi¬ 
mental  results  from  the  system  include  examples  of  the  analysis  of  complex 
sentences,  disambiguation  of  multisensed  words  via  sentence  context,  question 
answering  via  logical  inference,  and  meaning -preserving  paraphrase  generation. 
The  authors  conclude  that  sophisticated  natural  language  processing  by 
computers  is  a  realistic  goal  that  has  been  partly  achieved.  The  rate  of 
progress  toward  complete  achievement  is  seen  to  be  proportional  to  the 
amount  of  developmental  support  available. 
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A  Computational  Model  of  Verbal  Understanding 

Robert  J.  Simmons 
John  F.  Burger 
Robert  M.  Schwarcz 

I.  Introduction  and  Background 

The  long-term  goal  for  computational  linguistics  is  to  increase  our 
understanding  of  linguistic  and  conceptual  structures  and  to  formally  describe 
them  so  that  computers  can  deal  effectively  with  natural  languages  in  such 
applications  as  question  answering,  stylistic  and  content  analysis,  essay 
writing,  automated  translation,  etc.  The  eventual  realization  of  this  goal 
requires  not  only  a  satisfactory  model  of  linguistic  structures,  but  also 
models  for  verbal  understanding  and  verbal  meaning.  In  this  paper  we  outline 
a  theory  and  a  model  of  verbal  understanding  and  describe  Protosynthex  111, 
an  experimental  implementation  of  the  model  in  the  form  of  a  general -purpose 
language  processing  system.  The  effectiveness  of  the  model  in  representing 
the  process  of  verbal  understanding  is  demonstrated  in  terms  of  Protosynthex 
Ill's  capability  to  disambiguate  English  sentences,  to  answer  a  range  of 
English  questions  and  to  derive  and  generate  meaning -preserving  paraphrases. 

Background :  Computational  linguistics  is  fortunately  a  field  in  which 
there  is  no  dearth  of  state-of-the-art  surveys.  Over  the  last  three  years, 
Bobrov,  Fraser  and  Quilliar.  [1967],  Kuno  ^1966j  and  Simmons  ,.1966.,  have 
independently  reviewed  recent  relevant  literature  in  structural  linguistics, 
semantics,  psycholinguistics  and  computer  language  processing.  A  critical 
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survey  is  even  now  in  press  by  Salton  [1968]  to  cover  most  recent  trends.  A 
survey  of  question -answering  systems  by  Simmons  [1965]  describes  the  earlier 
developments  in  that  area. 

Several  very  recent  lines  of  research  by  Quillian  [1965,  I966J,  Colby 
[1966,  1967],  Bohnert  [1966],  Abelson  [1965],  Green  and  Raphael  [1967]  and 
Simmons,  et  at.  [1966,  1967,  1968]  have  introduced  ideas  of  deep  logical 
and/or  conceptual  structures  to  represent  understanding  of  phrases  and 
sentences  from  natural  language.  Theoretical  papers  by  Katz  [1967], 

Woods  [1968]  and  Schwarcz  [1967]  and  experimental  work  by  Kellogg  [1967a,  b] 
have  advanced  our  understanding  of  how  to  accomplish  various  forms  of  semantic 
analysis.  Recent  papers  by  Kay  [1966,  1967 ]  have  been  of  great  value  in  expli¬ 
cating  anC  generalizing  computational  methods  for  syntactic  analysis  with 
particular  reference  to  various  forms  of  transformations. 

These  surveys  and  recent  lines  of  research  lead  to  the  conclusions  that 
the  field  of  computational  linguistics  is  a  very  active  one,  developing 
computational  techniques  at  a  rate  that  keeps  pace  with  the  advances  in 
structural  linguistic  theory.  Unfortunately,  excepting  for  the  Abelson  and 
Colby  models  and  cognitively  oriented  works  by  Miller  et  al.  [I960J, 

Deese  Ll967j  aid  Reitman  [1965],  there  appears  still  to  be  a  significant  lack 
of  psychological  theory  of  verbal  understanding  to  guide  computational 


experimentation. 
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II.  A  Representation  of  Deep  Conceptual  Structure 

Such  operations  as  semantic  analysis,  question  answering,  paraphrase 
and  mechanical  translation  each  require  the  explication  or  transformation 
of  concepts  that  are  signaled  or  communicated  by  sentences  in  natural 
language.  The  concepts  being  communicated  via  language  are  not  the  words  nor 
the  phrases  nor  any  other  explicit  structure  of  a  discourse.  Instead,  what 
is  being  communicated  is  some  set  of  relations  among  cognitive  structures 
(i.e.,  ideas)  that  are  held  in  common  between  a  speaker  and  a  hearer  of  the 
language.  The  linguistic  notion  of  deep  syntactic  structure  is  a  partial 
recognition  of  this  fact,  but  for  computers  to  demonstrate  "verbal  under¬ 
standing"  and  manipulate  "verbal  meanings,"  an  even  deeper  level  of  conceptual 
structure  must  be  represented.  This  deep  conceptual  structure  serves  as  a 
partial  model  of  verbal  cognition,  i.e.,  of  how  a  human  understands  and 
generates  meanings  communicated  by  language.  The  effectiveness  of  a  model 
of  verbal  understanding  can  be  evaluated  in  terms  of  how  well  it  supports 
such  criteria!  operations  as  disambiguation,  question  answering,  paraphrase, 
verbal  analogies,  etc.  Whether  the  model  truly  represents  the  operations 
that  humans  actually  use  is  another  question  and  one  to  be  studied  by 
psychological  experiment. 

We  thus  define  verbal  understanding  as  the  capability  of  a  system  to 
disambiguate,  paraphrase,  translate  and  answer  questions  in  and  from  natural 
language  expressions.  Verba!  meaning  is  defined  as  the  set  of  interrelations 
in  the  model  among  linguistic,  semantic  and  conceptual  elements  that  provides 


this  competence. 
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Our  general  model  of  understanding  derives  from  a  theory  of  structure 
proposed  by  Allport  [1955]  in  the  context  of  psychological  theories  of 
perception.  Our  models  also  owe  a  conceptual  debt  to  such  widely  varying 
sources  as  Chomsky's  [1965]  theory  of  deep  syntactic  structure,  Quillian's 
[1966]  semantic  nets  and  most  recently,  to  Fillmore  [ 1966,  1967]  who  proposes 
a  significant  variation  t 3  the  Chomsky  deep  structure. 

The  primitive  elements  of  our  general  model  are  concepts  and  relations. 

A  concept  is  defined  either  as  a  primitive  object  in  the  system  or  as  a 
concept-relation-concept  (C-R-C)  triple.  In  the  model  of  verbal  understanding, 
a  concept  that  is  a  primitive  object  corresponds  to  a  meaning  or  word  sense 
for  a  word.  But  even  these  "primitives"  can  be  defined  as  a  structure  of 
C-R-C  triples  that  can  be  transformed  to  a  verbal  definition.  A  relation  can 
also  be  either  a  primitive  object  or  a  C-R-C  triple.  Ideally,  all  relations 
should  be  primitive  and  well-defined  by  a  set  of  properties  such  as  transitivity, 
reflexivity,  etc.  Since  each  property  corresponds  to  a  rule  of  deductive  in¬ 
ference,  well-defined  relations  are  most  useful  in  making  the  inferences 
required  for  answering  questions  or  solving  verbal  problems.  Any  relation, 
primitive  or  complex,  can  be  defined  in  extension  by  the  set  of  pairs  of 
events  that  it  connects.  However,  unless  the  relation  is  definable  inten- 
sionally  by  a  set  of  deductive  properties,  its  use  in  inference  procedures 
is  generally  limited  to  the  substitution  of  equivalent  alternate  forms  of 
expression. 

Any  perception,  fact  or  happening,  no  matter  how  complex,  can  be  repre¬ 
sented  as  a  single  concept  that  can  be  expanded  into  a  nested  structure  of 
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C-R-C  triples.  The  entire  structure  of  a  person's  knowledge  at  the  cognitive 
or  conceptual  level  can  thus  be  expressed  as  a  single  concept  or  event;  or  at 
the  base  of  the  nervous  system,  the  excitation  of  two  connected  neurons  may 
also  be  conceived  as  an  event  that  at  deeper  levels  may  be  described  as  sets 
of  molecular  events  in  relation  to  other  molecular  events. 

Meaning  in  this  system  (as  in  Quillian's)  is  defined  as  the  complete  set 
of  relations  that  link  a  concept  to  other  concepts.  Two  concepts  are  exactly 
equivalent  in  meaning  only  if  they  have  exactly  the  same  set  of  relational 
connections  to  exactly  the  same  set  of  concepts.  From  this  definition  it 
is  oovious  that  no  two  nodes  of  the  concept  structure  are  likely  to  have 
precisely  the  same  meaning.  A  concept  is  equivalent  in  meaning  to  another 
if  there  exists  a  transformation  rule  with  one  concept  as  its  left  half  and 
the  other  as  its  right.  The  degree  of  similarity  of  two  concepts  can  be 
measured  in  terms  of  the  number  of  relations  to  other  concepts  that  they 
share  in  common.  Two  English  statements  are  equivalent  in  meaning  either 
if  their  cognitive  representation  in  concept  structure  is  identical,  or  if 
one  can  be  transformed  to  the  other  by  a  set  of  meaning  preserving  transfor¬ 
mations  (i.e.,  inference  rules)  in  the  system. 

English  sentences  can  be  mapped  onto  the  deep  conceptual  structure  of 
tiiis  model  of  verbal  understanding  by  considering  prepositions,  conjunctions 
and  verbs  as  relational  terms,  and  nouns,  adjectives  and  adverbs  as  concep¬ 
tual  objects.  Thus,  a  sentence  such  as  "The  angry  pitcher  struck  the  careless 
batter"  can  be  expressed  in  the  following  set  of  relational  triples: 

♦From  a  logician's  point  of  view,  the  C-H-C  structure  can  be  seen  as  a  nested 
set.  of  binary  relations  of  the  form  R(C,C);  the  referenced  statement  is  a 
claim  that  any  event  car.  be  described  in  a  formal  language  of  such  triples. 
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A.  (((pitcher  MOD  angry)  TMOD  the)  struck  ((batter  MOD  careless)  TMOD  the)) 
As  it  stands,  this  is  simply  a  form  of  syntactic  diagramming  of  the  sentence 
(■where  MOD  and  TMOD  are  modif icational  relations).  However,  by  using  the 
semantic  analysis  procedure  to  be  described  in  Section  III,  the  selection  of 
word  sense  meanings  is  made  explicit  as  follows  (SUP  means  "has  as  a  semantic 
superclass" ) : 

3.  (((pitcher  SUP  player)  MOD  (angry  SUP  amotion)  TMOD  the) 

( struck  SUP  hit) 

((batter  SUP  player)  MOD  (careless  SUP  attitude)  TMOD  the)). 

The  particular  sense  of  "pitcher"  is  the  one  that  is  "a  kind  of  player";  the 
sense  of  "strike"  is  "to  hit"  and  the  sense  for  "batter"  is  "player."  The 
complex  element  ( struck  SUP  hit)  is  the  relational  term  for  the  larger  triple 
((pitcher,  etc.)  (struck  SUP  hit)  (batter,  etc.)). 

When  the  triple  structure  B  is  embedded  in  the  conceptual  model,  it 
can  be  roughly  represented  by  the  graph  of  Figure  1. 

The  result  of  embedding  the  sentence  in  the  conceptual  structure  is  to 
nake  explicit  many  aspects  of  verbal  meaning  that  were  implicit  in  the 
selection  and  ordering  of  words  in  the  English  sentence.  Without  any  analysis 
or  context  the  example  sentence  would  answer  only  the  question  "Is  it  true 
that  the  angry  pitcher  struck  the  careless  batter?"  With  such  a  relational 
analysis  and  embedding  in  the  conceptual  structure  a  whole  range  of  new 
questions  can  be  answered--for  example: 

Is  a  pitchei  a  person? 

Is  a  batter  a  baseball  player? 

Did  a  baseball  player  hit  a  person? 

Do  persons  have  attitudes? 

etc. 
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However,  Figure  1  is  only  an  approximate  representation  of  the  actual 
conceptual  structure.  The  subscripts  on  each  word  in  Figure  1  represent  the 
word  sense  and  concept  selection  appropriate  to  the  sentence.  In  the  actual 
structure  a  concept  number  occurs  for  each  word  on  the  graph.  Each  unique 
sense  of  meaning  for  a  word  corresponds  to  exactly  one  concept  number;  but 
each  concept  number  may  map  onto  more  than  one  word  sense  and  onto  a  defining 
structure  of  concepts.  For  example,  the  words  "young"  and  "youthful"  share 
a  sense  meaning  in  common,  viz.,  "having  the  characteristics  of  youth."  In 
each  case  this  sense  meaning  corresponds  to  a  concept  number,  say  C72.  C72 

might  be  defined  by  the  structure  (C72  EQUIV  (CO  C42  C55))  which  translates 
into  "C72  is  equivalent  to  something  having  youth." 
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Figure  1.  A  Graph  of  Cui.'eptunl  Structure 
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What  the  conceptual  structure  does  is  to  allow  word  meanings  to  be 
represented  by  a  single  conceptual  object  but,  at  the  same  time,  to  allow  a 
conceptual  object  to  be  expressible  in  many  different  verbal  forms.  The 
conceptual  level  is  necessary  for  paraphrase  and  translation  operations.  For 
example,  the  English  expressions  "old  man"  and  "ancient"  and  the  French  word 
"vieux"  can  all  be  expressions  of  a  single  concept  which  we  will  label  C37. 

The  structure  (raan^  MOD  oldc) — where  the  subscripted  "c"  means  the  concept 
number — is  a  defining  term  for  C37  which  is  one  of  the  word  senses  for  "ancient 
and  for  the  French  word  "vieux."  When  the  semantic  analysis  system  produces 
(manc  MOD  oldc)  it  tests  to  discover  whether  the  triple  can  be  expressed,  as 
in  this  case  it  can,  as  a  single  concept.  In  the  generation  system  that 
concept,  C37,  can  be  expressed  by  any  of  its  mappings  onto  word  senses  and 
thus  onto  words. 

This  particular  version  of  a  structure  for  verbal  understanding  is  our 
current  model.  It  has  shown  itself  strong  enough  to  support  many  kinds  of 
verbal  understanding  operations,  but  in  our  experimentation  with  it,  we  have 
found  that  it  is  not  as  deep  a  structure  as  we  would  like  to  have.  In  this 
structure,  for  example,  the  equivalence  of  the  two  statements  (a)  "Mary  bought 
a  boat  from  John,"  and  (b)  "John  sold  a  boat  to  Mary"  can  only  be  discovered 
by  a  transformation  rule  of  the  following  form: 

((X  (buy  from  Z)  Y)  EQUIV  (Z  (sell  to  X)  Y))  . 

Using  lexical  data  in  this  form  would  allow  analysis  of  the  example  sentence,  b 
into  something  like  the  following  deep  conceptual  structure: 
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transfer 


- 1 - K - 
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0BJ1 
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boat 
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<money 

possession 


possession- 
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final 


initial  final 


John 


Mary 


Mary 


John 


By  changing  the  relative  positions  of  Mary  and  John  in  the  structure,  the 
transfer  can  be  expressed  as  "buy"  or  "sell"  and  the  identity  of  meaning  for 
the  two  expressions  a  and  b  is  made  explicit.  The  transfer  concept  could 
equally  well  express  ideas  of  "get,"  "take,"  "give,"  "exchange,"  "borrow," 
"steal,"  etc.,  as  partially  analyzed  by  Bendix  [1966],  The  additional  advan¬ 
tage  of  this  kind  of  structure  is  that  it  suggests  that  all  relations  in  the 
cognitive  model  can  indeed  be  well-defined  by  contrast  to  our  present  unsatis¬ 
factory  mix  of  well-  and  poorly-defined  relations.  However,  the  detailed 
deiJnition  of  such  improved  structures  remains  still  to  be  done  as  a  later 
piece  o*1  research  than  the  or.e  reported  here.  It  is  mentioned  in  passing  to 
demonstrate  that  the  deeper  the  conceptual  structure  used,  the  more  explicit 
become  the  meanings  expressed  in  English  sentences. 

Assuming  i or  the  moment  our  assertion  that  the  model  we  have  first 
described  does  support  the  criteria!  operations  of  verbal  understanding,  the 
important  question  is:  By  what  means  can  we  transform  English  sentences  into 
such  a  conceptual  s  ructure?  Section  III  immediately  following,  describes  a 
method  of  syntactic  and  semantic  analysis  that  accomplishes  the  transformation  . 
flection  IV  describes  experiments  to  test  the  system's  capabilities  for  dis¬ 
ambiguation,  paraphrase  and  mestion  answering. 
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Following  a  line  of  thought  suggested  by  Fillmore  [1967],  we  believe  a  deeper 
conceptual  structure  than  we  are  now  using  might  very  well  express  the  concepts 
of  "buy"  and  "sell"  as  examples  of  "transfer”  somewhat  as  follows: 
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transfer  possession 


object. 
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property 
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initial 


final 


possession 


•Ononey 
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initialj  final 
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final 
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2  |  object2 

<Jnoney 
goods> 


agent 


dative 


|  initial  final 
dative  agent 
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III.  Analytic  Method 

The  representation  of  the  underlying  deep  conceptual  structure  described 
in  the  preceding  section  makes  possible  various  meaning -preserving  operations 
on  the  concepts  that  are  communicated  by  natural  language  statements.  The 
problem  of  transforming  from  English  statements  ar.d  questions  into  that 
structure  requires  both  syntactic  and  semantic  analysis.  In  an  earlier  paper 
[Simmons  and  Burger,  I968J  we  described  a  method  of  semantic  analysis  that 
worked  well  for  fairly  uncomplicated  sentences  but,  for  lack  of  powerful 
transformational  rules,  was  weak  with  regard  to  certain  complicated  structures. 
The  method  described  here  introduces  transformational  machinery  that  has 
proved  adequate  for  the  most  difficult  sentence  structures  that  we  have 
experimented  with. 

The  method  of  analysis  requires  a  lexicon,  a  grammar  that  includes  trans¬ 
formations,  a  set  of  semantic  event  forms  (SEFs),  and  a  modified  Cocke 
algorithm  to  actually  carry  out  the  analysis.  In  brief,  the  method  finds 
immediate  constituents  of  the  surface  structure  of  the  sentence,  transforms 
these  into  the  form  of  deep  conceptual  triples  and  tests  each  such  triple  for 
semantic  well-formedness.  The  resulting  analysis  is  a  bracketed  structure 
of  triples  with  each  element  marked  for  its  selection  of  word  sense  meaning 
or  concept.  /II  analyses  that  are  allowed  by  the  grammar  and  SEFs  are  produced. 
A  person  operating  the  system  is  given  the  opportunity  to  select  any  one  or 
several  interpretations  to  be  stored  in  the  conceptual  model. 
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The  Lexicon:  The  lexicon  is  composed,  cf  word  and  concept  entries.  With 
each  English  word  entry,  a  set  of  word  sense  meanings  is  associated;  each  word 
sense,  in  turn,  is  associated  with  a  syntactic  class,  a  set  of  syntactic 
features,  a  chain  of  semantic  word  classes  and  a  concept.  For  each  concept 
entry,  there  nay  be  a  pointer  to  one  or  more  word  senses  that  may  be  used 
to  express  that  concept  verbally  and  an  equivalence  relation  to  one  or  more 
concept  structures  that  represent  its  meaning.  Some  concepts,  however,  are 
not  expressible  as  single  word  senses  and  are  only  verbally  expressible  by 
deriving  the  word  senses  for  a  concept  structure  to  which  they  are  equivalent. 

In  addition  to  these  elements,  each  concept  entry  has  pointers  to  its  tokens 
in  the  data  structures  where  it  has  been  U6ed. 

The  semantic  word  classes  that  characterize  each  word  are  a  chain  of 
concepts  that  are  in  a  linguistic  superset  relation.  To  explain  by  example, 
the  word  "pitcher"  is  characterized  by  two  word  senses  and  thus  two  different 
chains  of  semantic  classes  as  follows: 

pitcher  . • .  N,  player,  person,  mammal 

...  N,  container,  physical  object,  object 
The  first  superset  chain  (or  SUP -chain)  means  that  "pitcher  is  a  kind  of  player  i 
a  kind  of  person  is  a  kind  of  mammal."  This  is  usually  expressed  as  "pitcher 
SUP  player  SUP  person...."  Actually  in  place  of  the  words  for  semantic  classes, 
the  lexicon  contains  concept  numbers  that  usually  refer  to  particular  word 
senses.  A  more  complete  example  of  dictionary  structure  is  presented  in 


Figure  2. 
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SENSE 

NBR 

SYNTACTIC 

CLASS 

SYNTACTIC 

FEATURES 

SEMANTIC 

CIASSES 

CONCEPT 

NBR 

BOYCOTT 

41 

N 

SING 

123,200 

53 

42 

V 

PL,  PR 

123,200 

53 

DISCOVERY 

55 

N 

SING 

98 

67 

DISCOVER 

56 

V 

PL,  PR 

98 

67 

Fir© 

34 

N 

SING 

98 

35 

V 

PL,  PR 

— 

98 

150 

V 

PL,  PR 

— 

123 

151 

N 

SING 

— 

124 

STRIKE 

207 

N 

SING 

67,  98 

100 

208 

V 

PL,  PR 

53,  123 

55 

ABBREVIATIONS:  SING  =  Singular 

PL  =  Plural 
PR  =  Present  Tense 


Figure  2.  A  Fragment  of  Lexical  Structure 

A  concept  is  created  for  the  system  for  each  new  word  sense  and  for  each 
occasion  when  an  equivalence  relation  occurs.  Since  every  word  sense  can  be 
defined  by  a  dictionary  definition  that  can  be  substituted  in  contexts  where 
the  word  in  that  sense  is  used,  it  follows  that  every  word  sense  concept  is 
in  an  equivalence  relation  to  some  other  concept  structure  that  expresses  its 
meaning.  In  the  actual  system,  not  every  concept  need  be  so  defined,  although 
the  power  of  the  system  for  verbal  understanding  obviously  increases  with  the 
number  of  concepts  that  are  defined. 
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The  concept  entry  for  the  second  sense  of  "strike"  in  Figure  2,  i.e., 
concept  number  55,  would  appear  as  follows: 

Concept  Word  Senses  Meaning  Used/ in 

C55  20 8  (CO  C89  C251)  G42,  045  ...  etc. 

This  example  shows  that  C55  may  be  expressed  verbally  by  sense  208  that  corre¬ 
sponds  to  the  singular,  present  tense,  verb  "strike."  By  looking  up  CO,  C89 
and  C251,  it  can  be  discovered  that  the  meaning  of  C55  can  also  be  expressed 
by  the  words  "to  stop  work."  The  list  of  G-prefixed  numbers  in  the  Used/ in 
column  are  simply  pointers  to  data  structures  in  which  the  concept  C55  has 
been  used  to  make  factual  statements. 

The  aim  of  this  form  of  lexical  structure  is  to  distinguish  clearly 

* 

between  linguistic  and  conceptual  information.  Syntactic  classes  and  features 
are  defined  as  those  elements  which  are  required  by  the  grammar  and  are  clearly 
linguistic  in  nature.  Semantic  classes  are  expressed  as  concepts  and  are  in 
a  borderline  area  between  the  linguistic  structure  and  the  deep  conceptual 
structure.  Semantic  classes  are  elements  of  the  semantic  event  forms,  but 
are  also  concepts  that  can  occur  anywhere  in  the  deep  conceptual  structure. 

The  Grammar:  For  discovering  immediate  syntactic  constituents  for  a 
sentence  and  transforming  them  directly  into  the  conceptual  structure,  we  use 
a  form  of  rule  that  combines  phrase  structure  rewrite  rules  with  a  transfor¬ 
mation.  The  form  of  this  grammar  can  be  understood  by  a  simple  example. 

(a)  adj  +  noun  — >  (B  MOD  A)  NP  =  (NP  (noun  MOD  adj) ) 

_ 

Although  the  lexical  and  conceptual  structures  provide  for  treatment  of  tense 
and  agreement  based  on  features,  the  analysis,  generation  and  question-answering 
algorithms  do  not  yet  use  this  information. 
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The  phrase  structure  component  states  that  an  adjective  followed  by  a  noun  can 
be  rewritten  as  a  Noun  Phrase.  The  transfc  nation  requires  that  the  Bth  or 
second  element  of  the  left  side  be  written  first  followed  by  the  term  MOD 
followed  by  the  Ath  or  first  element. 

A  more  complex  example  to  account  for  a  certain  type  of  discontinuity  is 
illustrated  below. 

(b)  adv  +  S  — >  (BA  (BB  MOD  A)  BC)  S 

=  (S  (Subject  (verb  phrase  MOD  adverb)  object)) 

The  transformation  of  (b)  states  that  the  BAth  element  of  the  left  side  is  to 
be  written  first.  The  Bth  element  is  S;  S  always  breaks  down  into  a  triple 
whose  Ath  element  is  a  noun  phrase,  whose  Bth  element  is  a  verb  phrase,  and 
whose  Cth  element  is  an  object  noun  phrase  or  an  explicit  null  symbol.  Thus 
the  BAth  element  is  the  Ath  element  of  the  Bth  element,  or  the  subject  of  the 
S  term.  Similarly  the  BBth  element  is  the  verb  phrase  and  the  BCth  element  is 
whatever  is  in  the  object  position. 

A  simple  grammar  to  account  for  the  sentence  "the  angry  pitcher  hit  the 
careless  batter"  is  presented  in  (c)  below: 

(c)  adj  +  noun  — ■>  (B  MOD  A)  NP 

art  +  NP  — >  (B  TMOD  A)  NP 

verb  +  NP  — >  (D  A  B)  VP 

NP  +  VP  — >  (A  BB  BC)  S 

The  string  of  syntactic  word  classes  corresponding  to  these  words  is  as  follow 
art  +  adj  +  noun  +  verb  +  art  +  adj  +  noun 
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The  analysis  that  results  from  this  grammar  is  as  follows: 

(S  (((noun  MOD  adj)  TMODart)  verb  ((noun  MOD  ad J )  TMOD  art ) ) ) 

In  a  previous  paper  [Simmons  and  Burger,  1968]  we  showed  that  this  type  of 
structure  can  be  obtained  by  applying  transformations  to  the  elements  of  a 
phrase  structure  analysis  of  a  sentence.  That  is  precisely  what  the  combined 
phrase  structure  and  transformation  rules  of  this  type  of  grammar  accomplish 
as  each  constituent  of  the  sentence  is  discovered. 

There  is  no  theoretical  limit  to  the  depths  to  which  the  transformational 
notation  can  refer;  strings  such  as  ABBBCAB  can  be  written  to  refer  to  the 
first,  second,  or  third  element  of  the  nth  level  of  depth  of  structure. 

Certain  elements  of  the  transformations  such  as  MOD,  D  (an  explicit  dummy  marker) 
and  the  brackets  are  taken  literally;  only  combinations  of  the  terms  A,  B,  and 
C  refer  to  the  structure  of  the  left-hand  side.  The  elements  in  a  rule  can  be 
semantic  classes  on  which  the  transformation  can  operate,  and  the  resulting 
constituent  can  be  a  composition  function  of  the  semantic  classes.  For  example, 
a  rule  might  be  written  to  analyze  the  phrases  "park  bench"  and  "wooden  bench" 
as  follows: 

place  +  furniture  — •>  (B  DOC  A)  fumiture-DOC 
and  material  +  furniture  — •>  (B  TYPE  A)  furniture-  TYPE 

Compositions  such  as  fumiture-LOC  imply  a  controlled  combination  of  the  SUP- 
chains  for  the  two  elements  in  a  manner  such  as  that  described  by  Katz  [1967] 
or  used  by  Kellogg  i  1967aJ. 

Rules  of  this  kind  would  eliminate  the  set  of  SEFs  and  the  separate  check 
for  semantic  acceptability.  The  disadvantage  would  be  an  enormous  increase  in 
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the  number  of  rules.  Consequently,  we  have  so  far  preferred  to  keep  separate 
the  syntactic  and  semantic  components  of  the  system. 

We  have  understood  the  transformational  component  of  these  rules  as  a 
program  that  operates  an  interpreter  whose  data  is  the  structure  identified 
by  the  names  of  the  two  constituents  on  the  left-hand  side.  Recently,  a 
paper  by  Kimball  [1967]  has  proved  that  a  certain  modified  form  of  Chomsky's 
transformations  can  completely  imitate  the  operation  of  a  Turing  machine. 

Because  of  the  limit  to  two  elements  on  the  left  side,  our  form  of  transfor¬ 
mation  is  less  powerful  than  this. 

In  applying  this  form  of  grammar  to  a  surface  string  of  syntactic  infor¬ 
mation  we  make  the  assumption  that  just  the  information  cued  by  syntactic  word 
classes,  and  by  syntactic  and  semantic  features> is  sufficient  to  allow  transfor¬ 
mation  to  the  underlying  deep  conceptual  structure.  It  has  so  far  been  possible 
to  write  transformations  that  account  for  very  complex  sentences  (as  will  be 
seen  in  Section  IV),  but  our  only  defen..  ■  ’’gainst  counterexamples  is  to  attempt 
to  demonstrate  that  a  grammar  can  be  built  to  account  for  each  challenge. 

Semantic  Event  Forms:  As  each  constituent  is  discovered  and  transformed 
according  to  the  grammar,  the  result  of  the  transformation  is  tested  for  semantic 
■  11-formedness.  The  SUP-chain  of  semantic  classes  and  a  set  of  semantic  event 
form  (SEF)  triples  whose  elements  are  semantic  class  terms  are  required  for 
making  this  test.  By  considering  our  example  sentence  again,  the  elements  ar.d 
method  of  this  test  can  be  explained. 

A.  Hie  angry  pitcher  hit  the  careless  batter. 

When  "pitcher"  was  looked  up  in  the  lexicon,  two  word  senses  were  discovered 
and  both  of  hese  were  nouns;  for  "angry"  there  was  only  one.  Thus,  two 
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constituents  of  the  form  "adj  +  noun"  were  discovered  to  represent  "angry 


pitcher."  The  SUP -chain  of  semantic  classes  that  represented  each  sense  of 


the  words  was  then  called  into  use  to  form 

pitcher  MOD 

player 

person 

animal 

mammal 

and 

pitcher  MOD 

container 
physical  obj 
object 


the  following  pair  of  complex  triples 

angry 

emotion 

feeling 

sense 


angry 

emotion 

feeling 

sense 


Thus  a  complex  triple  is  one  whose  elements  are  SUP-chains  of  the  elements  in 
a  simple  triple.  From  the  total  set  of  SEFs,  the  possibly  relevant  ones  are 
those  liiich  contain  one  or  more  elements  that  are  included  in  any  of  the  complex 


triples  of  the  sentence.  This  subset  of  SEFs  include  among  others  the  following 

(ANIMAL  MOD  EMOTION) 

(PERSON  MOD  ATTITUDE) 

(PHYSOBJ  MOD  QUALITY) 

(PERSON  HIT  PERSON) 

(OBJECT  HIT  PERSON) 

(PERSON  BOYCOTT  ORGANIZATION) 

ETC. 


The  test  for  semantic  well-formedness  is  to  discover  whether  any  triple  of 
elements,  selected  one  from  each  SUP-chain  in  a  complex  triple,  corresponds  to 
an  3EF-  In  the  present  example,  the  combination  (animal  MOD  emotion)  from  the 
first  complex  triple  does  correspond  to  »  .  SEF  in  the  list.  No  combination  of 
elements  from  the  second  complex  triple  corresponds  to  an  SEF’,  so  the  sense 
of  "pitcher"  as  a  "container"  does  not  apply  to  the  constituent  (N  MOD  Adj) 
for  that  sense  and  it  is  rejected.  For  the  acceptable  sense,  "pitcher"  as 
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"person,"  the  constituent  is  kept  and  elsewhere  it  is  stored  ao  ((pitcher  SUP 
player)  MDD  (angry  SUP  emotion)).  In  subsequent  constituents  using  this  complex 
constituent,  the  SUP-chain  of  semantic  classes  for  the  head  element  "pitcher 
SUP  person"  is  used  to  stand  for  the  entire  constituent. 

The  result  of  these  semantic  tests  is  to  reject  many  syntactic  constituents 
that  would  otherwise  lead  to  multiple  interpretations  of  the  sentence.  For 
example,  if  we  consider  the  number  of  common  meanings  for  "pitcher,"  "struck," 
and  "batter"  to  be  respectively  2,  3,  and  2  there  would  be  12  possible  interpre¬ 
tations  of  the  sentence.  By  use  of  the  three  SEFs  (ANIMAL  MOD  EMOTION)  (PERSON 
MDD  ATTITUDE)  and  (PERSON  HIT  PERSON)  only  the  one  interpretation  presented 
below  survives  tne  analysis  process. 

(((pitcher  .  person)  MDD  (angry  .  emotion))  (struck  .  hit) 

((batter  .  person)  MOD  (careless  .  attitude))) 

The  dot  pairs  are  used  for  conciseness  in  representing  (concept  SUP  concept). 

A  whole  series  of  questions  arises  at  this  point:  What  is  an  SEF?  How 
many  will  be  required  to  deal  with  a  large  subset  of  English?  How  does  one 
select  the  level  at  vhich  to  write  them?  These  and  others  are  questions  that 
we  have  considered  at  length  and  we  will  try  to  summarize  our  present  under¬ 
standing. 

It  appears  to  us  that  an  SEIF  is  an  abstraction  of  some  element  of  lexical 
information  that  should  (in  a  more  sophisticated  system)  be  directly  a  port  of 
the  lexicon.  It  appears  to  be  an  abstraction  expressed  in  terms  of  semantic 
classes  of  the  set  of  features  that  characterize  a  word's  combinatorial  possi¬ 
bilities  in  ordinary  usage  in  the  language.  For  example,  the  SEF  (ANIMAL  MOD 
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SENSE)  indicates  the  relationship  expressed  by  linguists  in  terns  of  a  restric¬ 
tion  on  sensory  verbs  and  adjectives  to  co-occurence  with  subjects  marked  by 
the  feature  "  +  animate."  We  believe,  for  the  present  state  of  computational 
linguistics,  we  can  better  represent  such  linguistic  data  in  the  form  of 
acceptable  combinations  of  semantic  classes  for  words--!. e.,  SEFs — and  later, 
from  the  useful  SEFs  work  out  underlying  features. 

We  have  no  answer  to  the  question  of  how  many  SEFs  would  be  required  to 
cover  a  large  subset  of  English.  A  related  device,  the  semantic  message 

forms  [Wilks, 1968]  are  based  on  approximately  fifty  semantic  classes  and 

* 

believed  by  ClittJ  researchers  to  allow  sufficient  combinations  to  account  for 
all  English  forms.  We  are  currently  tending  toward  the  belief  that  although 
the  separate  SEF  set  provides  adequate  machinery  for  relatively  small  subsets 
of  English,  this  information  must  eventually  become  an  integral  part  of  the 
lexicon  to  avoid  very  large  space  and  time  requirements  in  semantic  analysis 
of  large  sets  of  English. 

Selecting  the  level  at  which  to  write  an  SEF  is  hardly  more  easiJy  dealt 
with.  Considering  each  SEF  as  a  rule  of  semantic  combination,  the  task  is  very 
much  like  that  of  preparing  a  grammar.  One  attempts  to  obtain  the  minimal 
number  of  SEF  rules  that  will  distinguish  acceptable  and  nonacceptable  combi¬ 
nations  of  word  senses.  The  elements  of  each  rule  are  selected  at  the  highest 
level  of'semantic  abstraction  that  will  successfully  distinguish  all  word  sense 
that  are  in  a  superset  relation  to--i.e.,  subclasses  of — those  elements.  Thus, 
in  coining  the  GEF  (ANIMAL  MOD  EMOTION)  we  are  stating  our  understanding  that 
the  nature  of  these  concepts  is  such  that  anything  that  is  an  emotion  is 

5 
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restricted  to  modifying  only  those  things  that  are  animals.  Similarly  in 
(PERSON  BOYCOTT  ORGANIZATION)  we  restrict  the  concepts  that  are  kinds  of 
"boycott"  to  co-occurrence  with  things  that  are  persons  as  subjects  and  things 
that  are  organizations  to  receive  the  action. 

In  favor  of  the  SEF  approach,  we  have  found  them  simple  to  build  and  use 
and  of  the  same  functional  utility  as  the  semantic  markers  and  selection 
restrictions  of  Katz's  [1967]  current  semantic  theory.  Something  approaching 
the  function  of  his  projection  rules  can  be  seen  in  our  use  of  the  semantic 
class  of  the  head  of  a  construction  to  stand  for  the  semantic  classes  of  +  he 
whole.  However,  we  claim  only  that  the  SEF  approach  is  a  first  approximation 
to  expressing  semantic  information  that  should  be  an  integral  part  of  a  lexical 
entry  for  a  word  sense. 

The  Analysis  Algorithm:  After  several  experiments  in  producing  various 
forms  of  recognition  algorithms,  we  finally  concluded  that  the  Cocke  algorithm, 
was  superior  in  respect  to  conciseness,  completeness  and  efficiency  of  corpu- 
tation.  This  algorithm  has  been  presented  in  ALGOL  and  described  in  detail  by 
Kay  l19o7j.  Our  modifications  have  been  only  to  add  more  tests  on  each 
constituent  for  agreement  and  semantic  well-formedness  and  to  introduce  '  rans- 
fornations  into  the  operation  of  the  grammar. 

The  essential  operation  of  the  algorithm  is  to  test — exhaustively,  but 
ef ficiently--each  adjacent  pair  of  elements  in  a  sentence  structure  to  discover 
if  they  form  constituents  acceptable  to  the  grammar.  If  they  do,  the  pair  of 
constituents  are  rewritten  according  to  the  grammar  rule.  The  process  continues 
until  all  elements  of  the  sentence  are  encompassed  by  at  least  one  single  con¬ 
stituent  usually  named  3.  All  interpretations  acceptable  to  the  grammar  are  so 


formed. 
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IV.  Results 

The  complete  language  processing  system  that  has  been  described  has  been 
programmed  as  Protosynthex  III  in  LISP  1-5  for  the  SDC  Q-32  time-shared  computer. 
The  semantic  analysis  system  has  also  been  programmed  in  JOVIAL  and  used  to 
prepare  the  examples  on  pp.  33,  31*-  It  includes  the  capability  to  syn¬ 
tactically  and  semantically  analyze  single  sentences  into  the  formal  language 
of  the  conceptual  structure.  From  the  resulting  conceptual  structure,  the 
system  is  able  to  answer  a  range  of  English  questions  using  logical  inference 
procedures  based  on  properties  associated  with  the  well-defined  relations. 

It  is  also  able  to  paraphrase  by  finding  equivalence  relations  among  concepts 
and  to  generate  English  sentences  in  accordance  with  a  generation  grammar. 

In  this  paper  a  limited  set  of  examples  of  these  operations  will  be  presented; 
additional  computer  nrlntouts  of  examples  have  been  collected  as  a  special 
supplement  that  is  available  on  reqjest  from  the  authors. 

Syntactic  and  Semantic  Analysis:  The  grammar  reproduced  in  Figure  3  has 
proved  sufficient  to  account  for  the  analysis  of  the  sentences  in  the  following 
paragraph  about  physiological  psychology  of  the  eye. 

The  eye  is  the  organ  of  sight.  The  retina  ia  the  light  sensitive 
surface  of  the  eye.  Cones  and  rods  are  the  special  sensors  in  the 
retina.  Cones  and  rods  react  to  light.  When  we  see  anything,  we 
see  light  reflected  from  the  objects  we  look  at.  Reflected  light 
passes  through  the  lens  end  falls  on  the  retina  of  the  eye.  Seeing 
an  object  actually  means  seeing  the  reaction  of  our  retina. 

The  sentences  comprising  this  paragraph  were  selected  to  represent  a 

range  of  fairly  difficult  structures  including  various  kinds  of  embeddings. 
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(((OPP  GRFAJ)  ( BA  HP  (PC  MB  MOJ  S) 

(  ( DV'BE  MDJ)  <  AC  MOD  B)  CHPAJ) 

((VBFO  NP)  (BA  BB  BC)  (MB) 

(  ( NNP  IVBt)  CtAA  FCUlV  BC)  AB  (AC  FUCiV  HI,  J  j  b> 

(  (  VOO  b)  (BA  BB  BCJ  b> 

( ( VUO  bl  )  (BA  hb  PC)  b) 

(CUNCC  b>  l BA  Bb  AA)  b) 

(  (UNDO  b  1  )  t  BA  Bb  AA)  S  ) 

(  (  UN  DVBF)  (BC  FCUIV  A)  b) 

(  ( QN  VDO)  (A  B  D)  G/NDO) 

((UAVLO  S)  (BA  < BB  MOD  AA )  BO  b) 

((UAV  V  DC )  (A  B  0)  C'AVDO) 

< ( APj  PP)  (A  PR  BC )  A I  J  ) 

(  (  ADJ  NP  )  <  B  MOD  A  )  NR  ) 

((VCOMP  PWIVCCMP)  (A  BP  PC)  CONJVCCMP) 

( < CON J  NR)  (DAB)  NCOMP) 

(  <  ('.On  J  VCOMP)  <1>  A  B)  Pkl  VCOMP ) 

( (PKFP  ON)  (  D  A  B)  ypp) 

<  <  PP  i  P  (JNP)  (  0  A  B)  PP) 

((PKFP  NP)  (  li  A  B)  PP  ) 

((KFLAVH  CON JS )  CPA  A  BC)  b) 

<  <  S  C0NJSPK1 )  (A  PR  BC)  CONJS) 

((COM  bl)  ( L  A  B)  CONJbPKl ) 

((COM  b)  (L  A  b)  CONJbPKl) 

( ( V  P  p  NP)  (H  bMOL  t  *0  bJ  tC I  m  bj)  Nr) 

(  (  VF  D  PP)  (A  HB  BO  VCCMp  F  P  ) 

( ( Akl  NP )  ( B  1  MOD  A )  NP ) 

((NP  NCCMP)  (A  BB  BC)  NNP ) 

( (NP  V)  (AH  ♦  ***)  b) 

((NP  VCOMP)  (A  B  ***♦)  B) 

((NP  PKBD)  (A  BH  BC)  b) 

((NP  VPhFP)  (A  H  ***♦)  bPKBP) 

((NP  SPKFP)  (A  b.MOf  (FA  (PHA  BBB  A)  BC  )  )  Nr) 

((NP  CONJVLON'P)  [[A  HA  **♦*)  Bp  In  bl  ****))  (.(Njo 

(  ( NP  PP  )  (A  BB  HO  NP  ) 

((NP  VCOMp  F  D )  (A  bMOp  [♦OPjF.Cl  H  Aj)  NO 
((NP  CONJbPKl )  (A  BB  BC)  CONJb) 

((V  PP)  (A  HH  HO  VCOMP) 

(  (  V  DNP  )  (  (1  A  H  )  PK  F  O 
(  (  V  NP  )  (  D  A  P  )  PK  F  I.  ) 

(  (  V  PK  F  P  )  (A  P.  1  )  VPh  FP  ) 

(  (  DNP  rVBF)  (A  tuolv  HO  b) 

(  (  DNP  PKH  )  (A  HB  PC  J  b) 

(  (  VP  F  KtLPK)  (D  A  p)  VP  F  O 

(  ( VBF  DNP)  (I  A  H)  |  VHF  ) 

< ( VHF  NP)  (D  A  H)  PKFD) 

(  (  I  Ah  1  Nr )  ( H  I  MOD  A  )  |  NP  ) 

((iPlJUlV  **)  (l  r  O  MtNHi) 

((»*  H • b  F  U )  (A  PH  PC  )  b)> 

N  IL 

Figure  3«  Hecognition  Grar.r.nr  Ruler, 
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Example  1,  below,  shows  the  manner  of  inputting  the  sentence  and 
dictionary  data  into  the  system. 


ANALYSIS  MJDE  // 

KEADY-- 

THE  EYE  IS  THE  JKGAIM  JE  SIGHT  •  •  RUDYPKT  EUNCTIJN  v/ 1  S  l  JIM  * 

JKGAIM  EUUlV  BJDYPKl  • 

(SUPS-  THE  EYE  IS  THE  JKGAIM  JF  SIGHT) 

DDET  JKGAIM  EOU I  V  DDET  BJDYPkT  EUnCTIUn  VISIUn 
(SUPS-  UISIJN  EUIMCTIJN  RJDYPKT  DDEi  UKGAN  UJET) 

CJGACT  ASoJC  OBJECT  * T JP  BJOYPKT  ♦  7  UP 
(SUPS-  BJDYPKT  JHJECI  ASSJC  CJGACT) 

OBJECT  ♦  T  JP  ♦  IJP  ACT 
(SJPS-  ACT  OBJECT ) 

DU  *T JP 
(SJPS-  DU) 

♦  TUP 

(WCS-  (SIGHT  •  UISIJ'M) 

(  JE  .  EJ.MCIIJ'M) 

(JKGAIM  .  RJDYPKT) 

(THE  •  DDET)  (IS  •  EQJW)  (EYE  •  JKGAIM)  (IKE  .  l)OEI>) 

IMP  PKEP  IMP  DAK  r  URE  NP  DAK  T 
1 

P 

l  (  (  E  Y  E  •  JKGAIM)  THUD  (  1  H  E  .  DDF_I>> 

(EQJW  .  PKIHIT) 

(((JKGAiM  .  BJUYPKI!  (  JE  .  EJ.MCIIUN)  (SIGHT  .  WlSlJ'M)) 

IMJU  (THE  .  DDET ) )  J 


Example  1. 

A  sentence  is  typed  in  followed  by  a  period.  Optionally  a  set  of  super¬ 
sets  for  each  word  of  the  sentence  can  then  be  input  followed  by  a  period. 
Followiii  -  this  second  period,  SEF  triples  can  be  given  to  the  system  as  was 
done  in  Example  1.  The  third  period — i.e.,  the  one  following  the  SEFs — is 
taken  by  the  system  to  mean  completion  of  input.  At  that  point  the  system 
looks  up  each  word  in  the  dictionary  to  obtain  superset  classes  and  syntactic 
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word  classes.  If  it  does  find  these,  it  requests  SUPS  for  each  word  that  is 
not  in  the  dictionary.  It  reiterates  this  request  for  semantic  word  classes 
until  each  word  has  developed  a  SUP-chain  that  terminates  with  the  symbol, 
♦TOP.  It  then  asks  for  syntactic  word-classes  with  the  request  "WCS-" 
identifying  the  word  sense  by  using  the  dot  pair  (word  .  superclass).  When 
all  these  data  are  present — either  already  in  the  dictionary  or  having  been 
input  with  the  sentence — the  system  computes  its  semantic  analysis  using  the 
grammar  and  SEFs  available  to  it.  In  Example  1,  the  bracketed  structure 
shows  the  syntactic  analysis  and  the  selection  of  word  senses  for  each  word 
in  the  sentence.  This  example  shows  that  the  system  correctly  transformed 
"is"  in  the  context  "The  NP  is  the  NP"  into  the  well-defined  relation  "EQUIV." 
The  relation  "TMOD"  is  used  by  the  system  to  alert  it  to  the  presence  of  an 
article.  If  the  article  is  definite  it  refers  to  a  particular  or  already 
existing  token  of  data;  if  the  article  is  indefinite  or  absent  it  is  under¬ 
stood  to  represent  any  token  or  instance  of  its  concept. 

The  most  complex  sentence  of  the  paragraph  is  presented  as  Example  2, 
below.  The  analysis  of  this  sentence  shows  four  embedded  sentences  each  of 
which  is  surrounded  by  square  brackets.  The  first  of  these,  "We  see  light" 
is  in  an  IMPLY  relation  to  the  remainder.  The  expression  "...light  reflected 
from..."  gives  rise  to  a  noun  phrase  that  is  modified  by  the  sentence  "*0biect 
reflected  ...  light,"  where  "*object"  stands  for  "something."  The  phrase 
"...frcm  objects  we  look  at  "  gives  rise  to  the  structure  (object  SMOD  we 
(look  at  objects)  ****),  a  noun  modified  by  an  intransitive  sentence  that 
uses  that  noun  as  the  object  of  a  preposition.  By  following  the  syntactic 
word  class  pairs  through  the  grammar  of  Figure  3,  the  interested  reader  can 
observe  the  application  of  relatively  simple  transformations  to  compute  these 


structures. 


April  19^3 


30 


SP-3132 


RFADY-- 

WHEN  WE  SEE  AN  r  I  H I  N  G  .  WE  SEE  LIGHI  REFlECIEO  FROM  I  HE  J8JECTS 
wE  lJJk  AT  .  .  CJGACT  UWARD  OBJECT  »  PERSJN  CJGAC]  ♦  *♦♦» 

THRJWRACK  SOURCE  JRJECT.  OBJECT  THROWBACK  KADI  A 7  I JN > 

PERSJN  CJGACT  JRJECT  .  PERSJN  CJGACT  RADIATION" 

PERSJN  CJGACT  JRJECT  »  PERSON  CJGACT  ENERGY »  SEN  CJM  SEN. 

SEN  IMPLY  SEN  . 

CSJPS-  WHEN  WE  SEE  ANYTHING  .  WE  SEE  LIGHT  REELECTED  FRJM  OBJECTS  WE 
lJJk  AT ) 

IMPLY  PERSJN  CJGACT  JRJECT  CJM  PERSON  CJGACT  KADI  All  ON  IHKJwBACK 
SJJRCE  JRJECT  PERSJN  CJGACT  TJwAKO 

CSJPS-  TOWARD  PERSJN  SJJRCE  T  HR JWRACK  RADI  ATI JN  PERSJN  CJM  PERSJN 
IMPLY) 

DIRECTION  ANIMAL  LJC  ACT  ENERGY  ANIMAL  *  I JP  ANIMAL  *  1  OP 
(SUPS-  ANIMAL  ANIMAL  ENERGY  LJC  ANIMAL  DIRECTION) 

JBJEC1  OBJECT  ♦TJP  ♦UP  JBJECT  LJC 
CSJPS-  LJC) 

♦  TOP 

CwCS-  CAT  •  TOWARD) 

CLJJK  .  CJGACT) 

CwE  .  PERSJN) 

OBJECTS  .  JBJECT) 

C  FR  JIM  .  SJJRCE) 

CkEFlECTED  .  THROWBACK) 

ClIGKT  •  RADIATION) 

C  SEE  .  C  JGACT) 

CWE  •  PERSJN) 

C.  .  COM) 

CANfTHlNG  •  JBJFCI)  C  SEE  .  CJGACT)  CwE  •  PERSJN)  CWHEn  .  IMPLY)) 
PREP  V  NP  NP  PREP  VFD  NP  V  NP  CJM  NP  J  NP  KELAVB 
I 

PrInT 

CCCWE  •  PERSJN)  C  SEE  .  CJGACT)  CANYTHInG  -  JBJECT)  J 
CWHEN  .  IMPLY) 

CCWF  •  PEHSJN) 

C  SEE  •  CJGACT) 

CCLIGHT  •  RADIATION) 

SMJD  [ C ♦ JB JEC I  •  PR I M I f ) 

CCREFLECTED  .  THROWBACK) 

C  FR JM  .  SOURCE) 

CC  OBJECTS  •  JBJECT) 

SM  JD  C  C  WE  .  PERSJN) 

C  C  LJJK  .  CJGACT)  C  A 1  .  TOWARD)  OBJECTS  •  OBJECT)) 

(♦♦♦♦  .  PRI MIT) J) 

T MOD  C  THE  •  ODED)) 

Cl  I GHT  •  RADI A1 I JN)  3)  3  J 


1 
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Examples  of  the  analysis  of  question  structures  are  shown  in  Example  3, 
below.  In  some  cases  the  question  word  is  deleted  while  in  others  the  question 
is  transformed  to  declarative  structure. 


K£ A0Y-- 

on  */£  S£€  ANYTHING  ’ 

I 

P 

U'lli  .  Pr:yS0lv>  ( S  t  K  .  CO'jACM  (ANYfHlKS  .  (MJ)1 
1 


XtAJ  Y-- 

W  hAT  00  S->:  7 

1 

P 

(( ■*>£  .  Pr;yS0N)  (Sr>;  .  COGauI)  <  whaT  .  0-5J)] 

I 

x  1  r 

iWHrN  Xt,  S  *i  r  ANYTmIN'i  .  nhaI  i  j  0  Sr.t  0 

(  S  IH  S -  '*»  H*C  N  A  N-YT  n  I  N  G  j  ) 

-i<i  LA  xH  0-5  J 
C  0VN-  A 

<SJH->-  Cr'f-.YA  yrLAx/~l) 

00  0  0 

(  *CS  -  (,  .  COK'.v.A)  (  A  \  Y  T  n  J  N’j  .  0-5  J)  <*Hr.N  .  yKLAx/A)) 

C  0>  iM->  <rl-WA 

1 


P 

1  f  f  •ik  .  y  K  y  s  0  is  >  (y-;-:  .  i;.v,a  i  1  >  (mmImino  .  o , . ) )  j 

(  v  M  r  ,N  .  <  L  A  O  M  ) 

(  C  VrL  .  Hr.  y  S  ON  )  (S'  f.  .  C  (J  iA  l  I  )  (  a  MO  I  .  0  J  )  )  I 

1 

y  t  A  o  y  -  - 

hoa  oo.o  t hc;  cH.itcr  s>.nu;i  i  ighi  7 
(s  ins-  ho  *  00- s  y-.KLrici  > 

wasNit  00  r  hh  o" 

VA  N\ry  00  r  my  0  aMack 

(  S  l->  ">-  VAN  NtA  ) 

0 J  IA  I 

(  a";n  -  ( y  r.  r"  I  r.  (J  r  .  r  Hy  OaMac*  )  <(’-t-ir.il  .  IHJ)  cm'-:-)  .  >0)  (HU  .  vuNf’-t) 

0  N  H  x/OQ  UAx/ 

I 

p 

f  <  (  0-i  Jt  CT  .  ("HI)  Tv>Ot)  (|rc.  .  Ii-I)) 

<  <y  E  K  LK  CT  .  THyOvAAO  )  V  OU  (rU  .  -ANNry)) 

(LIGHT  .  yAO  I  AT  I  ON  )  ] 

1 


Example  3 
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Disambiguation:  An  example  deriving  from  Katz  [1967]  was  chosen  to 
illustrate  the  system's  ability  to  select  correct  word  senses  from  a 
potentially  ambiguous  situation.  The  example  frame,  "The  man  hit  the 
colorful  ball"  is  varied  by  substituting  "gave,"  "attended"  and  "hit"  in  the 
verb  slot.  The  relevant  dictionary,  grammar  and  SEF  entries  are  presented 
in  Figure  k.  Since  the  dictionary  provides  two  senses  each  for  "colorful," 
"ball"  and  "gave,"  in  the  worst  case  the  frame  using  "gave"  might  provide 
eight  interpretations  (as  it  in  fact  did  without  SEF  checking).  With  the 
use  of  the  relevant  SEFs,  the  system  provided  the  interpretations  shown  in 
Example  U.  The  two  interpretations  for  "...gave  a  colorful  ball"  are 
expected  in  that  SEFs  are  allowed  for  "person  present  object"  and  "person 
present  event."  In  the  remaining  cases  of  "hit  and  "attend"  only  one  inter¬ 
pretation  was  obtained. 

Answering  Questions:  Our  approach  to  answering  questions  in  this  system 
is  described  briefly  in  Simmons  and  Silberman  [1967].  A  more  detailed 
description  of  the  question-answering  system  and  experiments  with  it  is  in 
preparation  [schwarcz  et_  al. ,  1968].  Briefly,  the  system  attempts  a  direct 
match  with  the  concept  structure  of  each  triple  resulting  from  the  semantic 
analysis  of  a  question.  Failing  to  find  a  direct  match,  it  generalizes  each 
element  of  a  question  triple  to  include  all  of  its  equivalences  and  subclass 
elements.  Thus  a  question  triple  with  the  element  "bird"  would  generalize  to 
include  "condors,  robins,  bluebirds,  etc."  This  approach  failing,  the  system 
uses  more  complicated  inferences  based  on  combinations  of  relations  into 
compound  and  complex  relational  products. 
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ANALYSIS 

♦♦ANALYSIS  MODE ♦♦ 

THE  MAN  CADE  A  COLO^F'JL  HALL  • 

2  INTERPRETATIONS 
1 

f ( MA N  T MOO  THE)  <GAD£  -  PRESENT* 

(  (  <RALL  -  SPHERE*  MOO  <COLORE!L  -  MOLT  1  COLORED » >  TMOO  A)  I 

NEXT/E  IN  I  SHED /R‘JLES /SEE  1  S  ">  NE  XT 

? 

[(MAN  TMOO  THE)  <GA VE  -  PRESENT* 

( ( <G A  LL  -  DANCE*  MOD  <COLOREJL  -  GAY*)  TMOO  A)} 

NE  XT  /E  INIS HED  /R'lLES/SEE  •  S’  E  1  N!  SHED 

THE  MAN  ATTENDED  A  COLORfJL  HALL  • 

1  INTERPRETAT ION 

I 

[(MAN  T MOD  ThE)  ATTENDED 
(  (  <R A LL  -  DANCE*  MOD  <COLOREJL  -  GAY*)  TMOD  A)  3 

NE  XT /E  INI  SHED /R  ILE S /SEE  •  S ’  h  I M SHED 

THE  MAN  HIT  A  COLORE'IL  HALL. 

I  INTERPRETAT ION 

1 

[  (MAN  T MOD  THE )  hit 

( ( <R A  LL  -  SPHERE*  MOd  <  lOLORh  JL  -  MOLT  I  COLOR  ED > )  f MOD  A)) 


Example  4 . 

Disambiguation  Example 
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LOOK')*3  r  Hi  MAK  GAVE  ATTE  NUtO  HIT  A  C0L08FJL  HALL  • 
T  HE  :  FUNCTION  W0*(0,  1  SENSE: 

1  ah  r  det 

nan:  function  wono.  i  sense: 

1  NP  PEHSON,  ANI*IAL,  OH  J 

GAVE ;  F  JNCTION  HO HD,  ?  SENSES  : 

1  V  PH E SENT,  OFFtH,  ACT 

p  v  T HANS F EH,  MOvt  1  AIT 

ATTENDED:  FUNCTION  WOHD,  1  St  N  SE : 

1  v  GOTO,  MOVE,  AIL 

HIT:  FUNCTION  rtOHU,  1  SENSE: 

1  V  CONTAir,  ACT 

A:  FUNCTION  HOHO,  1  SENSE: 

1  aht  oe r 

COLOHFJL:  FUNCTION  WOHi),  P  StNStS: 

I  AUJ  nULT  I  COL  OH  EO  ,  8HIGhT,  OJAL 

P  AO  J  GAY,  LIVELY,  DUAL 

\\\8ALL:  FUNCTION  WOHO,  p  StNStS: 

I  NP  SPHEHE,  08 J 

P  NP  0  A  NC  £  »  E  V  E  N  r 


PH  I  N  T  H'JLtS. 

AUJ  NP  (8  NOO  A)  NP 

AHT  NP  (8  rv,no  A  )  NP 

V  NP  (0  A  8  )  PH EU 
NP  PHEU  f  A  88  8  (  I  S 


SEES. 

C  P  E  H  S  0  N  PH E SENT  EVENT) 
(  PE  H  SON  P8  S  >>  T  08U) 
(PEHSON  GOTO  EVENT) 
(PEHSON  CONTACT  08  U ) 

(  E  VE  NT  v,ol)  GA  Y  ) 

(08.1  NO')  wUCT  I  COL  OH  El)  ) 


Figure  4.  Dictionary,  Grammar,  and  SEF 

Entries  for  Disambiguation  Example 
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We  believe  the  approach  is  very  general  and.  approximately  equivalent 

to  that  taken  in  the  General  Problem  Solver  iNewell  et  al.,  15>63j •  A  top- 

down  generator  is  used  to  transform  question  triples  according  to  possible 

inference  rules  and  various  heuristics  are  followed  to  minimize  tree  search 

among  the  resulting  vast  set  of  possibilities. 

For  examples  we  asked  questions  of  the  following  sentences: 

The  eye  is  the  organ  of  sight.  The  retina  is  the  light- 
sensitive  surface  of  the  eye.  Cones  and  rods  are  the  special 
sensors  in  the  retina.  Cones  ana  rods  react  to  light. 

These  sentences  were  analyzed  with  the  grammar  of  Figure  3  and  appropriate 

SHFs  to  limit  the  interpretations  to  one  per  sentence.  Questions  were  asked 

and  the  system  answered  as  in  the  following  examples: 

Hxample  5.  What  is  the  eye? 

Eye  is  organ  of  sight. 

Organ  of  sight. 

Example  6.  What  is  the  function  of  the  eye? 

Sight. 

Example  7.  What  is  the  surface  of  the  eye? 

Surface  of  eye  be  light-sensitive  surface. 

Surface  of  eye  be  retina. 

Light-sensitive  surface  of  eye  be  retina. 

Example  8.  To  what  is  the  retina  sensitive? 

Light-sensitive  to  light  surface. 

Example  ‘y.  'Wnat  are  the  sensors  in  the  eye? 

Sensors  in  eye  be  sensors. 

Sensors  in  eye  be  cones. 

Sensors  in  eye  be  rods. 
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Example  10.  Are  there  rods  in  the  eye? 

Sensors  in  eye. 

Example  11.  Does  the  eye  contain  cones? 

Retina  inverse-of-in  sensors. 

Sensors  in  eye  be  sensors. 

Sensors  in  eye  be  cones. 

Sensors  in  eye  be  rods. 

Example  12.  How  does  the  eye  react  to  light? 

Cones  and  rods  in  retina  in  eye  react  to  light. 

Rods  react  to  light. 

Cones  and  rods  react  to  light. 

Example  5  is  a  result  of  direct  lookup.  The  correspondence  of  "function" 
to  "sight"  in  Example  6  results  from  the  SUP-chain  "sight-cogact-function" 
showing  that  sight  or  any  other  cognitive  act  is  a  kind  of  a  function.  In 

this  example  also,  the  structure  (eye  EQUIV  (organ  ASSOC  sight))  Implies 

* 

(eye  ASSOC  sight)  by  right-collapsibility  of  the  "EQUIV"  relation.  The  relation 
"ASSOC"  is  defined  as  symmetric  and  thus  the  question  transforms  to 
(eye  ASSOC  function)  which  is  answered  by  (eye  ASSOC  sight). 

Example  7  is  essentially  a  direct  lookup  that  is  successful  because  of 
the  symmetric  property  of  EQUIV  that  allows  the  reversal  of  the  clauses. 

The  answer  to  Example  0  depends  on  an  additional  fact  given  to  the  system, 
"light-sensitive  means  sensitive  to  light."  With  this  added  information  the 
question  which  was  analyzed  to  tne  following  structure: 

(retina  MOD  (sensitive  TO  what)) 
is  directly  answered  by  the  structure: 

(retina  EQUIV  (surface  MOD  (sensitive  TO  light)))  . 

* 

Tne  property  ri  t -tollat.sibl>  is  defined  for  HI  as  follows: 

(XI  HI  (X?  H?  X3 ) )  IMPLIES  (XI  R2  X3). 
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Example  9  and  Example  10  require  a  chain  of  inference  depending  on  the 
property  transitive  attached  to  (in  .  contained-in) .  Thus,  "sensors  contained - 
in  retina,"  and  "retina  contained-in  eye"  imply  "sensors  contained-in  eye." 

In  Example  11  a  similar  logic  applies  with  the  addition  of  the  information 
that  "contained-in  inverse  contained." 

Example  12  shows  one  method  for  treating  simple  "how"  questions.  By 
analyzing  the  question  into  the  statement  "eye  reacts  to  light"  the  system 
naturally  returns  relevant  material,  which  is  one  main  requirement  of  such 
questions.  It  should  be  noticed,  incidentally,  that  the  transitivity  of  the 
contained-in  relation  is  used  again  in  this  example. 

The  quest ion -answering  system  has  two  important  weaknesses.  First,  we 
uo  r.ot  yet  formally  distinguish  between  the  requested  operation  (i.e.,  count, 
list,  name,  etc.)  and  the  data-identifying  portions  of  the  question.  This 
lack  partially  accounts  for  the  second  weakness — a  certain  degree  of  vagueness 
in  the  generated  answers,  as  can  be  seen  in  Examples  8  and  10,  where  appropriate 
answers  would  have  been  "light"  and  "yes"  respectively.  Syntactic  and  semantic 
inadequacies  in  the  generation  of  answers  will  be  discussed  in  the  following 
section. 

Syntactic  Generation  and  Lexical  Paraphrase:  Our  primary  emphases  in 
developing  a  theory  of  verbal  understanding  have  been  to  account  for  the 
recognition  of  verbal  meanings  as  communicated  by  sentences  and  to  demonstrate 
understanding  by  the  model's  ability  to  answer  English  questions.  Other 
measures  of  understanding  include  the  capabilities  for  syntactic  and  lexical 
paraphrase  and  for  the  generation  of  new  sentences  that  are  in  cort reliable 
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relations  to  the  data  that  have  been  stored  as  a  consequence  of  understanding 
mear.i n;r,  from  sentences  that  have  been  analyzed.  It  was  our  hypothesis  that 
the  structure  for  recognition  and  question  answering  would  prove  largely 
sufficient  for  generation  and  paraphrase.  In  the  main  this  hypothesis  was 
supported  ar.d  we  added  the  generation  grammar  and  the  special  machinery  for 
paraphrase  *0  the  model  ir.  short  order.  However,  it  is  apparent  that  gener¬ 
ation  and  paraphrase  fror.  deep  conceptual  structures  require  more  theoretical 
explanation  than  we  are  prepare  1  to  deal  with  in  this  paper.  Particularly 
required  is  an  outline  of  correspondences  with  and  contradictions  of  current 
generative  linguistic  theories.  At  this  point,  having  only  scratched  the 
surface  ir.  experimenting  with  the  generation  area,  we  will  present  a  brief 
discussion  of  our  method  and  save  detailed  treatment  for  a  later  paper. 

Generating  English  phrases  or  sentences  from  the  conceptual  structure 
accomplished  by  the  use  of  transformational  phrase  structure  rules 
similar  to  th-se  used  ir.  the  analysis  phase.  Since  the  structure  is  composed 
of  r.esoC.;  triples,  these  rules  have  the  form  of  a  three-element  left  half 
which  is  transformed  to  a  structure  or  a  string  as  a  right  half.  Example 
rules  for  generating  "the  angry  pitcher  struck  the  careless  batter"  are 
shown  below: 

(UP  MOD  ADJ)  (3  A)  HP 
(IT  TMOD  ART)  (3  A)  IIP 
(IIP  V  IIP)  (A  3  C)  3 
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The  notation  conventions  are  identical  to  those  used  in  recognition  rules 
(see  p.  18  ).  The  generation  algorithm,  given  a  complex  triple  of  concepts, 
first  discovers  for  each  concept  its  mapping  onto  word-sense  and  associated 
syntactic  class  and  associates  with  each  triple  of  concepts  a  triple  of 
word-classes.  Then,  beginning  with  the  most  deeply  nested  triple  and  working 
outward,  it  looks  up  each  triple  of  syntactic  word-classes  in  the  set  of 
generation  rules,  and  if  found  rewrites  that  triple  by  the  phrase  structure 
name  and  applies  the  transformation  to  the  associated  concept  triple.  This 
process  is  iterated  until  all  elements  in  the  nested  structure  have  beer, 
accounted  for  (whether  or  not  they  result  in  the  terminal  symbol  S).  If  a 
given  triple  can  be  rewritten  in  more  than  one  way,  the  algorithm  applies  all 
rules,  generating  several  syntactic  paraphrases  of  the  same  structure.  Thus, 
for  the  triple  (IIP  I>K)D  ADJ)  the  two  strings  "UP  that  is  ADJ"  and  "ADJ  HP'' 
might  result.  At  the  end  of  the  process  the  concepts  are  transformed  into 
print  images. 

Lexical  paraphrase  is  accomplished  by  allowing  the  free  substitution  of 
concepts  that  are  in  an  equivalence  relation.  These  concepts  may  map  onto 
words  or  phrases.  Thus  in  the  examples  presented  below,  "eye"  is  conceptually 
equivalent  to  "eyeball,"  and  "organ  of  sight"  is  equivalent  to  "sensor  for 
vision."  An  equivalence  class  is  established  by  the  statement  "X  3EQLIV  Y" 
which  is  semantically  analyzed  like  any  other  sentence  except  that  SSQU1V  is, 
ar,  operator  used  to  construct  an  equivalence  between  concepts  in  the  system. 
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The  following  examples  illustrate  both  syntactic  and  lexical  paraphrases 

accomplished  by  the  system: 

Example  13.  The  eye  is  the  organ  of  sight. 

The  eye  is  the  sensor  for  vision. 

The  eyeball  is  the  sensor  for  vision. 

The  eyeball  is  the  organ  of  sight. 

Example  lU.  The  retina  is  the  light-sensitive  surface  in  the  eye. 

The  retina  is  the  surface  that  is  light-sensitive  in  the 
eyeball. 

The  retina  is  the  sensitive  to  light  surface  in  the  eye. 

The  retina  is  the  light-sensitive  surface  in  the  eyeball. 

Example  15 •  Light  falls  on  sensitive  retina. 

Radiance  falls  on  retina  that  is  sensitive. 

Radiance  falls  on  sensitive  retina. 

Light  falls  on  surface  of  eye  that  is  retinal. 

Light  falls  on  retinal  surface  of  eye. 

Radiance  falls  on  retinal  surface  of  cranial  orb. 

No  stylistic  controls  have  so  far  been  established  to  select  either 

the  generation  transformation  or  the  lexical  item  where  several  choices  have 

been  offered,  and  in  expressing  answers  to  questions  no  method  has  yet  been 

developed  for  selecting  a  "best"  answer.  Such  controls  offer  an  entire  field 

* 

of  study  such  as  that  currently  in  progress  by  Klein.  Our  generation  pro¬ 
cedure  is  also  undeveloped  with  respect  to  choice  of  articles  and  the  various 
forms  of  agreement  in  tense,  number,  etc.  In  respect  to  such  syntactic 
features,  the  system  mokes  provision  for  recording  them,  but  we  have  not  yet 
used  then,  in  any  of  our  recognition,  question  answering  or  generation 
experiments. 


Personal  communication,  3.  Klein,  University  of  Wisconsin,  Computer  Sciences 
Department . 
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V.  Discussion  and  Conclusions 

In  the  preceding  sections  we  have  described  a  theory  and  a  model  of 
verbal  understanding  that  is  based  on  a  formalization  of  conceptual  structures 
sufficient  to  represent  a  wide  range  of  the  verbal  meanings  that  are  expressed 
in  English  sentences.  The  model  includes  a  linguistic  component  that  is 
composed  of  a  lexicon,  and  syntactic  and  semantic  systems  which  are  together 
sufficient  to  translate  from  a  wide  range  of  English  sentences  into  the  formal 
conceptual-  structure.  The  formal  conceptual  structure  includes  inference  rules, 
a  limited  quantificational  capability  and  a  logical  structure  of  relations  that 
are  definable  by  properties  for  use  in  inference  procedures.  These  features 
of  the  model  support  a  range  of  question  answering  and  verbal  problem  solving 
capabilities. 

The  model  has  so  far  been  limited  to  representing  single  sentence  r.ear. in 
althou<Ji  the  conceptual  structure  naturally  embeas  fragmentary  meanings  in. 
their  most  relevant  contexts.  We  do  not  believe,  however,  that  a  theory  of 
sentence  meanings  is  broad  enough  to  encompass  the  communications  media'.  ?,:  . 
natural  languages.  Related  work  in  our  laboratory  by  Olney  wl<g6"j  has  ir.ve.  • 
gated  anaphoric  and  discourse  analysis  to  a  degree  that  is  sufficient.  ‘  1, 
us  that  complete  under star, ding  of  a  sentence  can  only  be  modeled  in  the  cor¬ 
tex".  of  its  discourse  structure.  This  line  of  research  has  also  provide'  1 
several  workable  approaches  to  finding  antecedent  3  for  pronouns  and  other 
of  anaphoric  structures.  An  important  next  step  in  the  development  of  the  model 
will  be  to  incorporate  this  line  of  thought  and  oxrerire!.:  at  ion  and  so  o  :  01.  ; 


from  a  noael  of  sentence  uudern-  andirg 


to  one  t:,a: 
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In  Section  IV  we  have  briefly  shown  and  discussed  examples  of  the 
system's  capability  to  produce  syntactic  and  semantic  analyses  of  sentences 
and  questions;  to  select  appropriate  word  senses  according  to  context;  to 
answer  questions;  to  generate  English  sentences  and  to  produce  meaning¬ 
preserving  paraphrases.  We  believe  (but  have  not  shown)  that  only  minor 
modifications  are  required  for  the  system  to  deal  with  a  wide  range  of 
verbal  analogy  problems  and  to  accomplish  sentence-for-sentence  translation. 

We  claim  that  these  results  support  the  theory  of  verbal  understanding  out¬ 
lined  in  Section  II  said  demonstrate  that  this  theory  is  adequate  as  a  first 
approximation  to  account  for  how  natural  language  sentences  can  communicate 
verbal  meanings  from  one  person  (or  system)  to  another. 

Despite  this  strong  claim  for  our  model,  we  believe  that  it  is  only  one 
example  of  a  family  of  models  that  are  sufficient  to  support  a  theory  of 
verbal  understanding.  What  appears  to  be  common  among  members  of  this  family 
is  a  capability  to  represent  textual  information  as  a  structure  of  unambiguous 
concepts  and  well-defined  relations.  An  ideal  model  would  contain  only  well- 
defined  relations  to  connect  concepts,  each  of  which  might  in  its  turn  reduce 
to  a  structure  of  perceptual  features  which  themselves  were  well-defined 
primitives.  Such  an  ideal  may  never  be  attainable,  but  the  closer  we  approach 
it,  the  more  satisfactory  will  be  our  theories  of  verbal  understanding  and  the 
more  powerful  the  language  processors  that  can  be  constructed. 

A  number  of  weaknesses  in  the  model  have  become  apparent  as  we  have 
struggled  with  it.  Our  present  treatment  of  the  conceptual  structure  leaves 
us  too  tightly  bound  to  the  subject -verb -object  order  of  English  sentences  and 
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to  the  ordering  of  modifying  phrases.  By  shifting  to  structures  such  as 
those  outlined  on  p.13,  the  model  can  be  simplified  and  the  number  of  in¬ 
completely  defined  relations  can  be  reduced.  The  segregation  of  semantic 
event  forms  into  a  separate  neighborhood  from  the  lexicon  is  also  intuitively 
disturbing  and  probably  economically  unsupported le.  Temporary  weaknesses  in 
the  implementation  of  the  model  include  incomplete  developments  in  the  areas 
of  translating  from  English  to  logical  quantification,  the  treatment  of 
ir. flections  D-'d  agreements,  and  at  least  minimal  o*..i  0p 

sentence  generation  process.  These  are  considered  temporary  weaknesses 
because  in  each  case  we  have  designed  and  are  currently  implementing 
improvements. 

On  the  positive  side  we  are  very  pleased  with  the  model's  capabilities 
for  analyzing  exceptionally  complicated  English  sentences  and  obtaining  one  o 
more  interpretations  consistent  with  the  grammar  and  uhe  semantic  system. 

\le  were  excited  and  pleased  to  find  that  after  text  and  questions  have  bee:, 
semantically  analyzed  and  so  represented  in  a  formal  structure,  a  question- 
answering  system  is  essentially  identical  with  a  general  problem  solver.  ike 
relative  ease  with  which  syntactic  and  lexical  paraphrases  eon  be  venerated 
from  the  deep  conceptual,  structures  supports  our  oelief  that  the  Chomskyan 
veneration  model  is  unnecessarily  complicated  in  its  treatment  of  the  ir*  ef¬ 
face  between  semantic  interpretations  and  syntactic  base  structures. 

The  model's  implementation  as  a  LIST  1.5  program  leaves  much  to  ue 
desired.  It  is  slow  and  cumbersome  in  its  operation  and  sharply  limited  in 
storage  capability,  having,  in  its  final  version  11,000  words  o!  free  s.pa-e. 
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Yet  only  in  LISP  could  we  have  tried  so  many  variations  of  our  original  ideas 
until  we  were  able  to  formulate  them  in  terms  of  consistent  workable  programs. 
So  on  the  one  hand  the  system  owes  its  existence  to  the  facility  with  which 
complex  ideas  can  be  expressed  in  LISP  while  on  the  other,  since  sequential 
computers  so  poorly  fit  the  requirements  of  large  associative  networks  that 
LISP  is  well-suited  to  handle,  the  system  is  core-bound  and  painfully  slow. 

"Slow"  means  concretely  that  a  typical  sentence  requires  90  seconds  of 
compute  time  to  analyze  while  an  equivalent  question  requiring  no  great 
amount  of  inference  may  compute  for  three  to  four  minutes.  When  these 
compute  times  are  translated  to  wait -times  on  the  time-shared  system, 
analyzing  and  answering  a  question  may  take  from  fifteen  to  thirty  minutes. 
Experimenting  with  such  a  system  is  obviously  only  tolerable  to  the  most 
devoted  believers  in  the  eventual  value  of  computer  language  processing. 

In  consequence  a  JOVIAL  version  of  Protosynthex  III,  also  for  the  Q-30 

* 

time-shared  system,  has  been  designed  and  already  partly  programmed.  So 
far  the  semantic  analysis  and  generation  systems  are  operating.  Th-?  -  version 
has  access  to  eight  million  words  oi  disc  storage.  Its  computing  time  for 
sentence  analysis  is  gratifyingly  reduced  to  tenths  of  seconds  and  its  wait 
times  on  the  tine-shared  system  are  typically  within  the  turnaround  time  of 
j-Vj  seconds.  It  is  our  current  estimation  that  question  answering  with 
relatively  short  chains  of  inference  will  be  vastly  shortened  with  respect 
to  the  LISP  version. 


Detailed  design  and  programing  by  William  J.  Schoene. 
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Conclusions:  We  believe  that  the  present  system,  Protosynthex  III, 
demonstrates  beyond  question  that  sophisticated  natural  language  processing 
by  computers  is  a  realistic  goal  and  one  that  has  been  partly  achieved  here-- 
although  so  far  only  on  a  sentence-by-sentence  basis.  We  believe  we  have 
shown  that  with  an  appropriate  lexicon,  syntactic  arid  semantic  systems,  that 
a  wide  range  of  English  sentences  can  be  translated  with  relative  ease  into 
formal  structures  that  support  logical  operations  of  deduction  and  inference. 
It  is  further  apparent  to  us  that  when  a  question  and  an  answering  text  have 
been  translated  into  the  formal  concept  structure,  question  answering  fits 
into  the  theorem  proving  and  general  problem  •,  ing  models. 

These  conclusions  mean  to  us  that  there  is  little  mystery  attached  to 
the  problem  of  language  processing  by  computers --only  a  great  deal  of  work. 
Before  were  were  able  to  build  Protosynthex  III  as  a  demonstration  of  c  firs: 
ge  .cral-purpose  language  processor,  dozens  of  language  processors  and  hundreds 
of  man-years  of  research  had  to  be  ac  omp  '.ished  tlirov  hout  this  and  other 
countries.  Many  more  years  are  required  to  move  forward  from  thin  point  : o 
molds  that  car.  deal  with  discourse  structures,  with  large  bodies  of  tot:  nr; 
with  the  subtleties  of  meaning  expressed  by  metaphor,  by  stylistic  control, 

C  *  • '  • 

What  can  oe  accomplished  today  is  to  construct  limit  od  systems  that 
seal  in  a  limited  manner  with  limited  bodies  of  fox*.  Ouch  systems, 
programmed,  require  syntactic  and  semantic  information  in  the  form,  of  dic¬ 
tionary  entries,  recognition  ar.d  generation  grammars,  semantic  event  form.:-, 
and  properties  and  rules  of  inference  to  define  relations.  All  of  'hose 
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materials  must  be  generated  by  skilled  human  users  of  the  language  and  the 
system.  For  a  single  article  such  as  this  one,  thousands  of  lexical  entries 
and  hundreds  of  syntactic  and  semantic  rules  would  have  to  be  produced.  In 
itself,  this  linguistic  effort  would  require  months  for  the  first  article  and 
years  before  any  significant  subset  of  a  language  had  been  so  formally 
described. 

One  s  tch  limited  system  is  under  construction  for  application  to  a 
ti*ree-hour  computer-aided  instruction  lesson  and  the  linguistic  effort 
required  for  computer  modeling  of  the  lesson  has  been  begun.  The  outcomes 
of  this  study  f Simmons  and  Silberman,  1967]  should  teach  us  much  with  regard 
to  the  eventual  practicality  and  economic  feasibility  of  language  processing. 

In  the  closely  related  axea  of  answering  questions  from  data  bases  such  as 
census  reports  or  airline  guides,  the  CONVERSE  system  by  Kellogg  [1967  a,bj 
has  led  to  the  similar  conclusion  that  answering  English  questions  from  a 
data  base  is  an  eminently  feasible --though  possibly  expensive--operation 
requiring  significant  linguistic  effort  in  defining  and  formalizing  the  subset 
of  English  to  be  used. 

We  believe  that  this  and  other  papers  have  demonstrated  that  natural 
language  processing  by  computers  is  rapidly  approaching  a  developmental  phase 
in  which  the  application  of  sign*  leant  amounts  of  time  and  money  can  lead  to 
eminently  practical  results.  Significant  improvements  in  automated  translation, 
data  base  query  systems,  information  and  text  retrieval,  stylistic  and  content 
analysis  can  all  be  expected  in  the  near  future  providing  support  is  forthcoming 
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for  these  efforts.  This  support  will  not  only  be  required  for  the  computer 
programming  costs  but  also  in  equal  or  greater  measure  for  the  ancillary 
linguistic  effort  to  formalize  appropriate  subsets  of  natural  language. 


SP-3132 
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